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REFERENCE TO RELATED APPLICATION 
The subject matter of the present application is related to and may be advantageously 
combined with the subject matter of copending and commonly owned application U.S. Patent 
Application Serial No. 09/616,161, to Yakhnich et al, filed July 14, 2000, entitled "Method of 
Channel Order Selection and Channel Order Estimation in a Wireless Communication 
System/' incorporated herein by reference in its entirety. 



10 FIELD OF THE INVENTION 

The present invention relates generally to communication systems and more 
particularly relates to an apparatus for and a method of converting soft decision symbol 
information into soft decision bit information. 

BACKGROUND OF THE INVENTION 

15 In recent years, the world has witnessed explosive growth in the demand for wireless 

communications and it is predicted that this demand will increase in the future. There are 
already over 500 million users that subscribe to cellular telephone services and the number is 
continually increasing. Eventually, in the not too distant future the number of cellular 
subscribers will exceed the number of fixed line telephone installations. Already, in many 

20 cases, the revenues from mobile services already exceeds that for fixed line services even 
though the amount of traffic generated through mobile phones is much less than in fixed 
networks. 

Other related wireless technologies have experienced growth similar to that of 
cellular. For example, cordless telephony, two way radio trunking systems, paging (one way 

25 and two way), messaging, wireless local area networks (WLANs) and wireless local loops 
(WLLs). In addition, new broadband communication schemes are rapidly being deployed to 
provide users with increased bandwidth and faster access to the Internet. Broadband services 
such as xDSL, short range high speed wireless connections, high rate satellite downlink (and 
the uplink in some cases) are being offered to users in more and more locations. 

30 In connection with cellular services, the majority of users currently subscribe to digital 

cellular networks. Almost all new cellular handsets sold to customers are based on digital 
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technology, typically second generation digital technology. Currently, third generation digital 
networks are being designed and tested which will be able to support data packet networks 
and much higher data rates. The first generation analog systems comprise the well known 
protocols AMPS, TACS, etc. The digital systems comprise GSM, TDMA (IS-136) or 
5 CDMA (IS-95), for example. 

A diagram illustrating an example prior art communication system employing an inner 
and outer encoder in the transmitter, inner and outer decoding stages in the receiver and a 
noise source after the channel is shown in Figure 1. The communication system, generally 
referenced 10, represents the typical scheme that may be used in many of the communication 

10 services described above. In such as system, the transmitter 11 comprises an encoder 14, 
interleaver 15, symbol generator 16 and modulator 18. Input data bits 12 to be transmitted are 
input to the encoder 14 which may comprise an error correction encoder such as Reed 
Solomon, convolutional encoder, parity bit generator, etc. The encoder functions to add 
redundancy bits to enable errors in transmission to be located and fixed. 

15 It is noted that both the inner and outer decoders in the receiver have complimentary 

encoders in the transmitter. The outer encoder in the transmitter comprises the encoder 14, 
e.g., Reed Solomon, etc. The inner encoder comprises the channel 20 which often times can 
be modeled as an L-symbol long FIR-type channel. 

The bits output of the encoder are then interleaved wherein the order of the bits are 

20 changed so as to more efficiently combat error bursts. The rearrangement of the bits caused 
by interleaving improves the resistance to error bursts while adding latency and delay to the 
transmission. 

The bits output of the interleaver are then mapped to symbols by the symbol generator 
16. The symbol generator functions to transform the bits to modulator symbols. For 

25 example, an 8-PSK modulator converts input bits into one of eight symbols. Thus, the 
symbol generator generates a symbol for every three input bits. 

The output from the mapper is input to the modulator which receives symbols in the 
M-ary alphabet and generates the analog signal that is subsequently transmitted over the 
channel 20. The channel may comprise a mobile wireless channel, e.g., cellular, cordless, a 

30 fixed wireless channel, e.g., satellite, or may comprise a wired channel, e.g., xDSL, ISDN, 
Ethernet, etc. The processing performed in the transmitter is intended to generate a signal 
that can be transmitted over the channel so as to provide robust, error free detection by the 
receiver. 
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At the receiver 13, the analog signal from the channel is input to front end circuitry 22 
which demodulates and samples the received signal to generate received samples y{k) 21. 
The samples are first input to an inner decoder 24. An example of an inner decoder is an 
equalizer which compensates for the ISI caused by the delay and time spreading of the 
5 channel in attempting to detect the symbols that were originally transmitted by the modulator. 

Equalizers can be adapted to output hard symbol decisions or soft symbol decisions. 
Examples of commonly used types of hard decision equalizers include the maximum 
likelihood sequence estimation (MLSE) equalizer that utilize the well known Viterbi 
Algorithm (VA), linear equalizer and decision feedback equalizer (DFE). Examples of soft 
10 output type equalizers include Soft Output Viterbi Algorithm (SOVA) type equalizers and 
equalizers based on the Maximum A Posteriori (MAP) algorithm. 

In the case of a hard output equalizer, the output of the inner decoder comprises 
symbols s(k) 23 which represent hard decisions. If a soft output decoder is used, the symbols 
s(k) output of the inner decoder comprise soft symbol decisions. The output of the inner 
15 decoder is then input to a symbol to bit de-mapper 25 which is adapted to map the received 
symbols to bits. In the case of 8-PSK, for example, each symbol is mapped to three bits. 

The output of the symbol to bit mapper is then input to a bit de-interleaver 26 which 
. functions to restore the original order of the bits. The bits are then input to an outer decoder 
29 which functions to locate and fix errors using the redundancy inserted by the encoder. The 
20 outer decoder generates the binary receive data a# 1 7. 

Examples of the outer decoder include turbo decoders and convolutionai decoders that 
utilize the Viterbi Algorithm. This class of decoders provides better performance by taking 
into account soft information about the reliability of the received symbol. The improved 
performance of the decoder cannot be realized, however, when soft information about the 
25 received symbols is not available. Note that the Viterbi algorithm is widely used in 
communication systems and has been adapted to perform functions including demodulation, 
decoding, equalization, etc. Many systems utilize the Viterbi Algorithm in both the inner and 
outer decoding stages. 

As described above, the outer decoder, in some systems, is adapted to utilize the 
30 symbol decisions output from the inner decoder, e.g., the equalizer. Optimal decoders, 
however, require soft decisions rather than hard decisions. For example, an outer decoder 
that utilizes the Viterbi Algorithm to perform convolutionai forward error correction 
decoding, requires soft decisions as input. The advantage of a Viterbi decoder is that it can 
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efficiently process soft decision information. In order-to provide soft symbol decisions, the 
inner decoder typically comprises a soft output equalizer such as a SOVA or MAP based 
equalizer. 

In some cases, such as with a system using a punctured code or bit wise rather then 
5 symbol wise interleaving, soft symbol decisions cannot be used. In such cases, optimal 
decoders require soft bit inputs rather than soft symbol inputs. Soft bit decisions may 
comprise a bit value and the reliability of the decision. Alternatively, a soft bit decision may 
comprise only the reliability value for a ' 1' (or alternately '0') decision. 

Although the de-mapper maps the symbols into bits, there is no mechanism to convert 
10 the soft symbol decision information into soft bit decision information, which is needed by 
the soft outer decoder. 

The problem is illustrated when considering a receiver adapted to handle a GSM 
Enhanced General Packet Radio System (EGPRS) signal. Such a system utilizes a bit wise 
interleaver and punctured convolutional coding for performing Forward Error Correction 
15 (FEC) over channels that require equalization. Assume that the equalizer used employs a Soft 
Output Viterbi Algorithm in its operation and that the outer FEC decoder employs the Viterbi 
Algorithm. After de-interleaving, the soft symbol decision information output of the 
equalizer is no longer related to the bits output of the de-interleaver. 

A prior art technique for generating soft bit decisions is described in "A Soft-Decision 
20 State-Space Equalizer for FIR Channels," J. Thielecke, IEEE Transactions on 
Communications, Vol. 45, No. 10, October 1997. A nonlinear equalizer is described that is 
intended for FIR channels which is based on a state-space description of the channel. The 
algorithm utilizes equations that resemble a Kalman hard decisions feedback equalizer 
wherein the probability estimates of the received bits are incorporated. 
25 A disadvantage of this prior art technique is that the level of computational 

complexity is relatively high making difficult to implement in communication systems. In 
addition, the technique is restricted to a particular type of channel and a particular way of 
describing the channel. 
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SUMMARY OF THE INVENTION 
Accordingly, the present invention provides a novel and useful apparatus for and 
method of converting soft symbol decision information into soft bit decision information that 
overcomes the disadvantages of the prior art. The present invention is suitable for use with a 
5 wide range of communication systems and is particularly useful in receivers that comprise 
concatenated coding schemes whereby the output of an inner decoder is subsequently 
processed by an outer decoder wherein the outer decoder is a soft decision decoder whose 
performance is optimized when soft decision values are available. 

The invention is adapted to receive M soft symbol values where each symbol 
10 represents m bits ( M = 2 m ). Alternatively, M-\ soft symbol are input wherein the A** symbol 
is a reference symbol that is implied. A sub-optimal implementation of the invention is 
adapted to receive fewer than M soft symbol decisions. The output for each symbol 
comprises m soft values of bits representing the symbol. The invention is operative to 
convert the soft symbol values to soft bit values using the log likelihood ratios (LLRs) of a bit 
15 and a symbol expressed as conditional probabilities. As shown by simulations, the method of 
the invention provides for improved performance of several dBs. 

A key feature of the invention is that it is operative to convert soft symbol values to 
soft bit values which can subsequently be used by a soft input outer decoder thus realizing 
maximum performance therefrom. It is noted that the invention achieves this using a 
20 relatively low complexity technique described infra. 

The method of the invention is presented which can be performed in either hardware 
or software. A computer comprising a processor, memory, etc. is operative to execute 
software adapted to perform the soft symbol to bit conversion method of the present 
invention. 

25 The present invention enables the use of soft decoding in systems that incorporate a 

bit-wise rather than a symbol-wise interleaver. An example of such a system is the GSM 
Enhanced General Packet Radio System (EGPRS). The present invention is also applicable 
in systems wherein the encoder uses a different size alphabet than the modulator. A system 
may have 5 for example, a l A rate code encoder concatenated with an 8-PSK modulator. In 

30 such a system, the soft symbol decision information output of the equalizer in the receiver 
does not match the type of soft decision information required by the decoder. 



12410.0003 



5 



The invention provides the following advantages and benefits. The conversion of soft 
symbols to soft bits effectively decouples the modulator and encoder that utilize different size 
alphabets. It also makes the outer decoder independent of the type of equalizer used in the 
receiver so long as it can provide soft symbol decisions. In addition, the invention enables 
5 the use of either bit-wise interleaving or symbol-wise interleaving. In either case, the soft 
outer decoder is provided the necessary soft bit information. The soft bit output conversion 
method is computationally efficient in that a minimum of arithmetic operations are required 
for its implementation. 

A key benefit of the present invention is that the performance of any communication 
10 system embodying the present invention is enhanced by enabling the soft decoding of FEC 
codes, e.g., soft decoding of convolutional codes or the soft decoding of block codes, turbo 
codes, etc. 

There is thus provided in accordance with the present invention a method of 
generating soft bit outputs from soft symbol decisions for an M-ary symbol alphabet in a 

15 communication receiver coupled to a channel wherein the communication receiver includes a 
first decoder adapted to generate the soft symbol decisions from a received signal, the method 
comprising the steps of receiving M soft symbol decisions for each symbol, wherein each 
symbol is represented by m bits, partitioning the soft symbol decisions into m bit groups, each 
the bit group comprising a zero-bit portion and a one-bit portion, summing all soft symbol 

20 values in the zero-bit portion of a particular bit group of interest, so as to generate a first sum, 
summing all soft symbol values in the one-bit portion of a particular bit group of interest, so 
as to generate a second sum, computing a soft bit value for the particular bit of interest as a 
function of the first sum and the second sum and wherein m and M are positive integers. 

There is also provided in accordance with the present invention a method of 

25 generating soft bit outputs from soft symbol decisions for an M-ary symbol alphabet, the 
method comprising the steps of receiving m+1 soft symbol values for each symbol wherein 
each symbol is represented by m bits, and wherein the m+1 soft symbol values comprise a 
first soft symbol value corresponding to a most likely symbol and m second soft symbol 
values, wherein each the second soft symbol value corresponds to a symbol closest in 

30 Euclidean distance to the most likely symbol whose bit in the position of interest is opposite 
that of the analogous bit in the most likely symbol, computing a soft bit value for each bit of 
interest as a function of the first soft symbol value and the plurality of second soft symbol 
values and wherein m and M are positive integers. 

12410.0003 6 



There is further provided in accordance with the present invention a method of 
generating soft bit outputs from soft symbol decisions for an M-ary symbol, the method 
comprising the steps of receiving M soft symbol decisions for each symbol, wherein each 
symbol is represented by m bits, partitioning the soft symbol decisions into m bit groups, each 
the bit group comprising a zero-bit portion and a one-bit portion, selecting, for each bit group 
of interest, a first maximum soft symbol value from among the soft symbol values in the zero- 
bit portion, selecting, for each bit group of interest, a second maximum soft symbol value 
from among the soft symbol values in the one-bit portion, computing a soft bit value for each 
bit of interest as a function of the first maximum soft symbol value and the second maximum 
soft symbol value and wherein m and Mare positive integers. 

There is also provided in accordance with the present invention a method of 
generating soft bit outputs from soft symbol decisions, the method comprising the steps of 
receiving a plurality of soft symbol values for each symbol, determining, for each bit in the 
symbol, a first likelihood representing the probability that the bit is a one, determining, for 
each bit in the symbol, a second likelihood representing the probability that the bit is a zero 
and computing a soft bit value for the bit as a function of the first likelihood and the second 
likelihood. 

There is still further provided in accordance with the present invention a 
communications receiver for receiving and decoding an M-ary transmitted signal comprising 
a radio frequency (RF) front end circuit for receiving and converting the M-ary transmitted 
signal to a baseband signal, a demodulator adapted to receive the baseband signal and to 
generate a received signal therefrom in accordance with the M-ary modulation scheme used to 
generate the transmitted signal, a first decoder operative to receive the received signal and to 
generate a sequence of soft symbol decisions therefrom, a soft symbol decision to soft bit 
output converter comprising processing means programmed to receive a plurality of soft 
symbol values for each symbol, determine, for each bit in the symbol, a first likelihood 
representing the probability that the bit is a one, determine, for each bit in the symbol, a 
second likelihood representing the probability that the bit is a zero and compute a soft bit 
value for the bit as a function of the first likelihood and the second likelihood and a second 
decoder adapted to receive the soft bit values and to generate binary received data therefrom. 

There is also provided in accordance with the present invention a computer readable 
storage medium having a computer program embodied thereon for causing a suitably 
programmed system to generate soft output values by performing the following steps when 
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such program is executed on the system: receiving a plurality of soft symbol values for each 
symbol, determining, for each bit in the symbol, a first likelihood representing the probability 
that the bit is a one, determining, for each bit in the symbol, a second likelihood representing 
the probability that the bit is a zero and computing a soft bit value for the bit as a function of 
the first likelihood and the second likelihood. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The invention is herein described, by way of example only, with reference to the 
accompanying drawings, wherein: 

Fig. 1 is a diagram illustrating an example prior art communication system employing 
5 an inner and outer encoder in the transmitter, inner and outer decoding stages in the receiver 
and a noise source added to the channel; 

Fig. 2 is a block diagram illustrating a concatenated receiver incorporating a soft 
decision symbol to bit converter constructed in accordance with the present invention; 

Fig. 3 is a flow diagram illustrating the first soft decision symbol to bit method of the 
10 present invention; 

Fig. 4 is a flow diagram illustrating the calculation of soft decision bit information 
using the first soft decision symbol to bit method of the present invention; 

Fig. 5 is a diagram illustrating the symbol mapping of modulating bits and their 
arrangement into bit groups for Gray coded 8-PSK modulation; 
15 Fig. 6 is a flow diagram illustrating the second soft decision symbol to bit method of 

the present invention; 

Fig. 7 is a flow diagram illustrating the calculation of soft decision bit information 
using the second soft decision symbol to bit method of the present invention; 

Fig. 8 is a block diagram illustrating the functional processing blocks in a GSM 
20 EGPRS mobile station; 

Fig. 9 is a diagram illustrating the elements of a GSM burst including tail, data and 

training symbols; 

Fig. 10 is a graph illustrating BER at the output of the outer decoder versus SNR for a 
concatenated communications receiver constructed with and without the soft decision symbol 
25 to bit converter of the present invention; and 

Fig. 11 is a block diagram illustrating an example computer processing system 
adapted to perform the first and second soft decision symbol to bit conversion method of the 
present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 
Notation Used Throughout 



The following notation is used throughout this document. 



Term 


Definition 


AMPS 


Advanced Mobile Telephone System 


ASIC 


Application Specific Integrated Circuit 


AWGN 


Additive White Gaussian Noise 


BER 


Bit Error Rate 


TDM A 


Code Division Multiple Access 




Central Processing Unit 


TWF 


Decision Feedback Eaualizer 




Digital Subscriber Line 


nop 


Digital Sional Processor 




Enhanced Data rates for GSM and TDMA/136 Evolution 


FFPT?mv>r 


FWtricflllv Frasable Programmable Read Onlv Memory 




FnVmnrerl General Packet Radio Svstem 




FrM*\x/^rH Frrnr GorreotioTi 


TTTD 


Finifp 1 TmnnlQe T^pst^onse 


rruA 


Field Prnprarn triable Gate Arrav 


GTnP A XT 


GSM FDGE Radio Access Network 




Oaii^ian Minimum Shift Kevins 


VJOivl 


Global System for Mobile Communication 


TTR 
nrv 


Infinite Impulse Response 




Integrated Services Digital Network 


101 


Intersymbol Interference 




Log Likelihood Ratio 


MAP 


Maximum A Posteriori 


MCS 


Modulation Coding Scheme 




Maximum Likelihood Seauence Detection 

1 VXClAlllI villi ivlJVvllllV/VU- Vv| W-Vllvv A* wv w k*. v 


TUT QF 


Maximum Likelihood Seauence Estimation 


1 i3 IV 


Phase Shift Kevins 


I\_/\1V1 


RanHnm Aeeess M^emorv 


KUM 


f^r»1\/ A/Tpm nTV 


SER 


Symbol Error Rate 


SNR 


Signal to Noise Ratio 


SO 


Soft Output 


SOVA 


Soft Output Viterbi Algorithm 


SSA 


Suboptimum Soft-output Algorithm 


SSB 


Second Significant Bit 


TACS 


Total Access Communications Systems 


TDMA 


Time Division Multiple Access 


VA 


Viterbi Algorithm 


WLAN 


Wireless Local Area Network 


WLL 


Wireless Local Loop 
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Detailed Description of the Invention 

The present invention is an apparatus for and method of converting soft symbol 
decision information into soft bit decision information that overcomes the disadvantages of 
the prior art. The present invention is suitable for use with a wide range of communication 

5 systems and is particularly useful in receivers that comprise concatenated coding schemes 
whereby the output of an inner decoder is subsequently processed by an outer decoder 
wherein the outer decoder is a soft decision decoder whose performance is optimized when 
soft decision values are available. 

The invention is adapted to receive M soft symbol values where each symbol 

10 represents m bits (M = 2 m ). Alternatively, M-l soft symbols are input wherein the Af h 
symbol is a reference symbol that is implied. The output for each symbol comprises m soft 
values of bits representing the symbol. The invention is operative to convert the soft symbol 
values to soft bit values using the log likelihood ratios (LLRs) of a bit and a symbol expressed 
as conditional probabilities. Simulations are presented below that show the method of the 

1 5 invention provides a performance improvement of several dBs. 

A sub-optimal implementation is also described wherein a reduced set of soft symbols 
(m or are generated rather than the complete information packet. 

A block diagram illustrating a concatenated receiver incorporating a soft decision 
symbol to bit converter constructed in accordance with the present invention is shown in 

20 Figure 2. The communication system, generally referenced 30, comprises a concatenated 
encoder transmitter 32 coupled to a channel 42, and a concatenated decoder receiver 50. The 
transmitter 32 comprises an encoder 34, bit to symbol mapper 36 and modulator 38. Input 
data bits to be transmitted are input to the encoder 34 which may comprise an error correction 
encoder such as Reed Solomon, convolutional encoder, parity bit generator, etc. The encoder 

25 functions to add redundancy bits to enable errors in transmission to be located and fixed. 

The bits output of the encoder 34 are then input to an interleaver 35 which functions 
to rearrange the order of the bits in order to more effectively combat error bursts in the 
channel. The bits output of the interleaver are then mapped to symbols by the symbol mapper 
36. The bit to symbol mapper functions to transform bits to modulator symbols from an M- 

30 ary alphabet. For example, an 8-PSK modulator converts input bits into one of eight 
symbols. Thus, the mapper in this case generates a symbol for every three input bits. 
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The symbols output from the mapper are input to the modulator 38 which functions to 
receive symbols in the M-ary alphabet and to generate the analog signal therefrom that is 
subsequently transmitted over the channel 42. The channel may comprise a mobile wireless 
channel, e.g., cellular, cordless, fixed wireless channel, e.g., satellite, or may comprise a 
5 wired channel, e.g., xDSL, ISDN, Ethernet, etc. It is assumed that noise is present added to 
the signal in the channel. The transmitter is adapted to generate a signal that can be 
transmitted over the channel so as to provide robust, error free detection by the receiver. 

It is noted that both the inner and outer decoders in the receiver have complimentary 
encoders in the transmitter. The outer encoder in the transmitter comprises the encoder 34, 

10 e.g., convolutional, etc. The inner encoder comprises the channel 42 which, in one 
embodiment, can be modeled as an L-symbol long FIR-type channel. 

At the receiver 50, the analog signal from the channel is input to Rx front end circuitry 
52 which demodulates and samples the received signal to generate received samples y(k) 54. 
The samples are then input to an inner decoder 56. An example of an inner decoder is an 

15 equalizer which compensates for the ISI caused by the delay and time spreading of the 
channel The function of the equalizer is to attempt to detect the symbols that were originally 
transmitted by the modulator. 

Note that the equalizer may be adapted to output soft symbol values, e.g., a SOVA or 
MAP based equalizer. Alternatively, it may be adapted to output hard symbol decisions, e.g., 

20 a maximum likelihood sequence estimation (MLSE) based equalizer that utilizes the well 
known Viterbi Algorithm (VA), linear equalizer and decision feedback equalizer (DFE). In 
this case, soft decisions must be generated from the hard decisions. A technique for 
generating the soft decisions is described in U.S. Patent No. 5,457,704 to Hoeher et al., 
entitled "Post Processing Method and Apparatus for Symbol Reliability Generation," 

25 incorporated herein by reference in its entirety. Another suitable soft symbol generation 
technique is described in U.S Application Serial No. X, to Yakhnich et al., filed X, entitled 
"Soft Decision Output Generator," incorporated herein by reference in its entirety. 

Equalization is a well known technique used to combat intersymbol interference 
whereby the receiver attempts to compensate for the effects of the channel on the transmitted 

30 symbols. An equalizer attempts to determine the transmitted data from the received distorted 
symbols using an estimate of the channel that caused the distortions. In communications 
systems where ISI arises due to partial response modulation or a frequency selective channel, 
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a maximum likelihood sequence estimation (MLSE) equalizer is optimal. This is the form of 
equalizer generally used in GSM and GERAN systems. 

The MLSE technique is a nonlinear equalization technique which is applicable when 
the radio channel can be modeled as a Finite Impulse Response (FIR) system. Such a FIR 
5 system requires knowledge of the channel impulse response tap values. The channel estimate 
is obtained using a known training symbol sequence to estimate the channel impulse 
response. Other equalization techniques such as DFE or linear equalization require precise 
knowledge of channel. 

The channel estimation 68 is operative to generate a channel estimate h{k) that is used 

10 by the inner decoder 56 (i.e. equalizer). The channel estimation is generated using the 
received input samples y{k) 54 and the training sequenceX^)- 

Several methods of channel estimation that are known in the art and suitable for use 
with the present invention include, for example, a correlation method and a least squares 
method. The correlation method is described in detail in "GSM System Engineering," A. 

15 Mehrotra, 1997, Chapter 6 and in the article "On the Minimization of Overhead in Channel 
Impulse response Measurement," Y. Han, IEEE Transactions on Vehicular Technology, Vol. 
47, No. 2, May 1998, pages 631-636. The least square method of channel estimation is 
described in more detail in the articles "Improved Channel Estimation With Side 
Information," A.S. Khayrallah, R. Ramesh, G.E, Bottomley, D. Koilpillai, IEEE, March 1997, 

20 pages 1049-1051 and "Impact of Blind versus Non-Blind Channel Estimation on the BER 
Performance of GSM Receivers," D. Boss, T. Petermann, K. Kammeyer, IEEE Signal 
Processing Workshop on Higher-Order Statistics, July 21, 1997, pages 62-67 and in the book 
"Adaptive Filter Theory " S. Haykin, 1996, Chapter 1 1 (Method of Least Squares). 

Another channel estimation technique suitable for use with the present invention is 

25 described in the Yakhnich et al. reference entitled "Method of Channel Order Selection and 
Channel Order Estimation in a Wireless Communication System" cited supra. 

For purposes of the invention, it is assumed that soft symbol values 58 are available at 
the output of the inner decoder 56. Preferably, the soft symbol values are in the form of Log 
Likelihood Ratio (LLR) values, i.e. LLR(s*). Note that a hard decision is one of the possible 

30 values a symbol s(k) can take. A soft decision, in the ideal case, comprises the reliabilities of 
each possible symbol value. The soft decision comprises a complete information packet that 
is needed by the decoder. An information packet is defined as the output generated by a 
detector or decoder within a single operation (See "Optimum Soft-Output Detection for 
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Channels with Intersymbol Interference/' Y. Li, B. Vucetic, Y. Sato, IEEE Transactions on 
Information Theory, Vol. 41, No. 3, May 1995). 

The soft symbol values are input to the soft symbol to soft bit converter 60 of the 
present invention. The converter is operative to convert the soft symbol information into soft 
5 bit information. The soft bit values for a symbol are derived by obtaining the conditional 
probability of a bit in terms of the probability of a symbol. The soft bit decision is calculated 
in the form of the log likelihood ratio (LLR) of the conditional probability. 

The soft bit decision information, e.g., LLR(^), output of the converter 60 is input to 
the bit- wise interleaver 62. The output of the de-interleaver comprises the soft bit values in 

10 the original bit order. The de-interleaved soft bit values are then input to the outer decoder 64 
which comprises a soft input decoder. The outer decoder functions to locate and fix errors 
using the redundancy bits inserted by the encoder. The outer decoder 64 generates the binary 
receive data utilizing the soft bit input. Examples of the outer decoder 64 include 
convolutional decoders utilizing the Viterbi Algorithm, etc. Soft decision Viterbi decoders 

1 5 have the advantage of efficiently processing soft decision information and providing optimum 
performance in the sense of minimum sequence error probability. 

The first soft decision symbol to bit method of the invention will now be described in 
more detail. A flow diagram illustrating the first soft decision symbol to bit method of the 
present invention is shown in Figure 3. The method described herein is performed by the soft 

20 symbol to soft bit converter 60 (Figure 2). It is assumed that an M-ary modulation scheme is 
used, with M = 2 m and having the alphabet 



Each symbol can then be represented by m number of bits. The modulation scheme used in 
GSM EDGE and GSM EDGE Radio Access Network (GERAN) systems is 8-PSK with m=3. 



A - {A 0 ,A 19 ...A m _ 1 } 



25 



The log likelihood ratio of a bit bu is defined as 



LLR(b k ) = hi 



P(y\b k =0) 



(1) 



and the log likelihood ratio of a symbol Sk having the value A t is defined as (step 70) 



LLR{s k =4) = ln 



Piy\s k =A) 
p(y\s k =A 0 \ 



(2) 
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The soft output equalizer produces at each time k for symbol st a soft output consisting of M 
symbol values. Alternatively, the soft output equalizer can produce MA soft symbol values 
wherein the M* h symbol value is a reference symbol that is implied by the converter. 

Each soft symbol value comprises the LLR^ = A { ) (or an approximation thereof) for 
5 z=l,..., Af-L The converter, utilizing the method of the present invention, processes these 
values for each time k and transforms them to Log Likelihood Ratios of m bits representing 
that symbol. The resultant bit Log Likelihood Ratios, defined in Equation 1, can 
subsequently be used to perform optimal decoding of forward error correction (FEC) codes. 

Next, the conditional probability of the input y is determined given a bit is equal to a 
10 zero and a one (step 72). Let it be defined that symbol Sk consists of m bits denoted by bj for 
7=0,..., ra-1. The probability of inputs given bj=l can be expressed as 

p{y\b =l)=— y — %~ 

- J } pip J =lj 

^p{s k =A^y) 

where 

y is a vector representation of the input; 

15 Sk represents the k th symbol; 

Ai represents the symbol value; 

bj represents the j th bit of the symbol; 

Djo and Dj\ represent the set of symbols wherein bj = 0 and 1, respectively; 
V/ e D Jt and bj(A } )=i for i=0 9 l;/=0,..., mA; 7=0,..., M-l. 



20 



A reasonable assumption can be made that the a priori probability of symbols and bits 
are equal (this is a valid assumption for most practical communication systems). 
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p{s k = A,)=±-yi 



M' 



^=0)=^=l)=i 



(4) 



Therefore, the following expression for the conditional probability of the input as expressed 
in Equation 3 can be rewritten in terms of Equation 4. 



5 Similarly, 



(5) 



(6) 



Then, the bit Log Likelihood Ratio (LLR) as defined above in Equation 1 can be expressed as 
follows (step 74) 



LLR(bj)= In 



= ln(ptl*,=l))-ln(p^|6 7 =0)) 

= {ln(i>(y | bj = l))- ln(p(y 1^=4, ))}- H p k 1 6 , = 0))- ln(pfc 1^=4, 



= ln 



(7) 



= ln 



■In 



= ln 



V 

^ f 
-In 

J 



p(l\s k =A,) 



10 Substituting Equation 2 into Equation 7 yields an optimal transformation of symbol LLR to 
bit Hi? (step 76) 



LLR^^lA £ e "*<*-4) 



-In 



LLR{s k =A[) 



(8) 



Thus, the log likelihood ratio for a bit is expressed as a function of the log likelihood 
ratios of the symbols. The soft symbol to soft bit converter is operative to generate at each 
1 5 time for symbol a plurality of m soft bit outputs 
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LLRipj) / = 0.../n-l (9) 

Note that the bit LLR derived using Equation 8 is the optimal transformation of symbol LLR 
to bit LLR. A suboptimal expression for the bit LLR can also be derived, as described in 
more detail herein below. Note also that one skilled in the communication and signal 
5 processing arts can modify the present invention to generate types of soft bit output other than 
log likelihood ratios. Other types of soft bit output derived using the principles of the present 
invention are intended to be within the scope of the invention. 

The method of calculating the soft bit values will now be described in more detail. A 
flow diagram illustrating the calculation of soft decision bit information using the first soft 

10 decision symbol to bit method of the present invention is shown in Figure 4. First, the 
symbol log likelihood ratios from the equalizer are organized into multiple groups according 
to the particular bit of interest and divided into a 0-bit portion and a 1-bit portion (step 80). 
To illustrate, consider an 8-PSK symbol used in EGPRS GSM systems wherein each symbol 
is represented by m=3 bits. In this case, the symbol values are organized into three bit groups 

15 as shown below in Table 1 . 



Table 1 : Symbols grouped according to bit position 



Bit value 


Msb 0=2) 


Mid bit (/=1) 


Lsb Q=0) 




000 


000 


000 




001 


001 


010 


0 










010 


100 


100 




011 


101 


110 




100 


010 


001 




101 


011 


011 


1 










110 


110 


101 




111 


111 


111 



For each bit position, the 0-bit and 1-bit symbols are grouped together. Thus, for the MSB bit 
20 position (/=2), all symbols whose MSB=0 are grouped in the upper c 0' portion of the table. 
Similarly, all symbols whose MSB=1 are grouped in the lower 6 V portion of the table. A 
similar process is performed for the mid bit (/=1) and LSB (/=0) positions. Although the bit 
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representation of the symbols are shown in Table 1, in actuality, the elements of the table 
comprise the soft symbol values, i.e. the log likelihood ratios. 

Next, for each bit position, the symbol log likelihood ratios for all symbols in the '0' 
partition are summed so as to yield a zero-bit sum (step 82). Similarly, the symbol log 
5 likelihood ratios for all symbols in the ' V partition are summed so as to yield a one-bit sum 
(step 84). The one-bit sum and zero-bit sum are inserted into Equation 8 and the log 
likelihood ratio for the particular bit is computed (step 86). 

The process of summing the symbols log likelihood ratios for the zero and one and 
subsequently computing the bit LLR is repeated for each bit position (step 88). The resultant 

10 bit LLRs are subsequently output to the soft outer decoder (step 90). 

Alternatively, the complexity of computing the bit LLR can be reduced by performing 
an approximation of the symbol probabilities. The approximation takes advantage of the 
rapid increase of the exponential function used in Equation 8. Rather than sum all zero and 
one symbols for each bit position as in the method of Figure 4, the maximum symbol value 

15 for the symbol where the bit of interest is a one and the maximum symbol value where the bit 
of interest is a zero is used instead. 

To aid in illustrating the approximation soft bit method of the present invention, the 
diagram in Figure 5 is provided that illustrates the symbol mapping of modulating bits and 
their arrangement into bit groups for a 8-PSK symbol as used in GSM EDGE systems. The 

20 symbol mapping diagram, generally referenced 100, is divided according to bit position. 
Dashed line 102 divides the 8 symbols into a group in which the MSB=0 and a group in 
which the MSB=1. Dashed line 104 divides the 8 symbols into a group in which the mid bit 
or Second Significant Bit (SSB)=0 and a group in which the mid bit=l. Dashed lines 106 
divide the 8 symbols into a group in which the LSB=0 and a group in which the LSB=1. 

25 The diagram 100 is used to determine which of the soft symbol values to use in 

computing the bit LLR. For each bit LLR that is to be computed, two symbol LLR values are 
required: one for the '0' bit and one for the T bit of the particular bit position of interest. 
Both are the maximum soft symbol values for the respective bits. The overall maximum soft 
symbol value is used for one of the bits while the soft symbol value of the nearest neighbor 

30 symbol whose bit is opposite to that of the overall maximum is used for the other. 

To illustrate, consider the symbol '101' whose corresponding soft symbol value, 
denoted by Sioi, is the overall maximum of all M symbols received from the equalizer. The 
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value Sioi is thus used for the maximum soft symbol value for the one-bit for bit position y=2, 
the zero-bit for bit position y=l and the one-bit for bit position j=Q. 

For the MSB, in accordance with the method, the zero-symbol value is the maximum 
of all symbols whose MSB=0. The symbol most likely to yield the maximum value is the 
5 symbol closest to symbol 101 whose MSB=0. From the diagram in Figure 5, this symbol is 
symbol 001. Thus, the soft symbol value of the 001 symbol is taken as the maximum zero- 
symbol value. In similar fashion, the nearest neighbor for the middle bit is symbol 110 and 
for the LSB is symbol 100. 

The nearest neighbors can be precalculated in accordance with the modulation scheme 
10 and the number of symbols in the constellation. To illustrate, the complete list of nearest 
neighbors for the GSM modulation of 8-PSK is presented below in Table 2. 



Table 2: Nearest neighbors for GSM 8-PSK modulation 



Reference Symbol 
(Most Likely Symbol) 


Msb Q=2) 


Mid bit 0=1) 


Lsb (/=0) 


000 


101 


010 


001 


001 


101 


010 


000 


010 


111 


000 


011 


011 


111 


000 


010 


100 


001 


110 


101 


101 


001 


110 


100 


110 


011 


100 


111 


111 


011 


100 


110 



15 Thus, for each symbol, only m+1 soft symbol values (the hard decision and m soft 

symbols) are required which results in reduced complexity for the equalizer and the soft 
symbol to soft bit converter. Note that m+1 soft symbol values are needed when the symbol 
conditional probabilities are referenced to the Aq symbol. If the conditional probabilities are 
referenced to the hard decision instead, only m soft symbols are required which reduces the 

20 data to be passed to the soft symbol to soft bit converter. 

Further, the table comprises M rows when the symbol conditional probabilities are 
referenced to an arbitrary constant (i.e. not a symbol). If the conditional probabilities are 
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referenced to a symbol (e.g., A 0 \ only M-l rows are needed. In the latter case, the LLR of the 
A=0 symbol is implied to equal zero. 

A flow diagram illustrating the second soft decision symbol to bit method of the 
present invention is shown in Figure 6. The log likelihood ratios for a bit is defined as 
expressed above in Equation 1 and for a symbol as in Equation 2 (step 1 10). The conditional 
probability of the input y given a one or a zero bit is determined as expressed in Equation 3 
above (step 112). 

As above, it is assumed that a priori probability of symbols and bits are equal allowing 
the expression for the conditional probability of the input to be rewritten as in Equations 5 
and 6. The bit Log Likelihood Ratio (LLR) as defined above in Equation 2 is determined as 
expressed in Equation 10 (step 1 14). 



(10) 



Consider the following which embodies the nearest neighbor approximation 



In 



P\y\^=A 0 )) ^1^=4,^ p(i\s k =A 0 ) p^k^J 



(ii) 



where n represents the second largest soft symbol after the maximum. Due to the rapidly 
increasing exponential functions in the expression for the bit LLR, the maximum symbol 

value is by far the most dominate probability and the remaining ^-1 soft symbol values can 

be ignored. Therefore, the following approximation is valid (step 1 16) 



In 



~ max 

ieD. 



In 



v 



(12) 



Thus, the maximum symbol values are is substituted for the zero-symbol and one-symbol 
sums. Substituting Equation 12 into Equation 10 yields 



LLRib, max 

K J ' laDj 



-max 



f 

In 

V v 



( p(l\s k =A) 



(13) 



Further substituting Equation 2 into Equation 13 yields an approximation of the 
transformation of symbol LLR to bit LLR (step 1 1 8). 
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LLRiPj )* max{LLR(s k = A, ))- max(LLR(s k = A ! )) (14) 

Thus, the log likelihood ratio for a bit can be approximated as the difference between 
a soft symbol value wherein the bit of interest is a one and a soft symbol value wherein the bit 
of interest is a zero. 

A flow diagram illustrating the calculation of soft decision bit information using the 
second soft decision symbol to bit method of the present invention is shown in Figure 7. The 
symbol log likelihood ratio values are organized into groups according to bit position, in 
similar fashion to optimal method described above in connection with Figure 4 and as shown 
in Table 1 (step 120). Note that this method assumes that all the soft symbol values for a 
symbol are received from the equalizer. 

For each of the m bit positions, the maximum soft symbol value from among the 
symbols whose bit of interest equals zero is determined (step 122). Likewise, the maximum 
soft symbol value from among the symbols whose bit of interest equals one is also 
determined (step 124). The log likelihood ratio for the particular is computed using the two 
maximum soft symbol values (step 126). A bit log likelihood ratio value is computed for 
each bit of the symbol (step 128). The resultant bit LLRs are subsequently output to the soft 
outer decoder (step 130). 

In an alternative embodiment, fewer soft symbol values are required from the 
equalizer. As described above, only m+l rather than M soft symbol values are required to 
compute the bit log likelihood ratios. For each symbol, the overall maximum soft symbol 
value from among all the symbol values is required along with an additional m soft symbol 
values. The additional m soft symbol values correspond to the nearest neighbors having a bit 
opposite to that of the symbol corresponding to the maximum soft symbol value. For the case 
of 8-PSK, the required symbol values are as listed in Table 2 above. 

It is noted that other approximations to find the log likelihood ratio are also possible, 
in addition to that described above. The approximation described above attempts to 



determine log^^- when only the ratios log 
expressed as log 



K P B J 



are available. The ratios were 



in order to approximate the sum by the maximal term (see 
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Equation 12). Another type of approximation suitable for use with the present invention can 
be expressed as 



log 



log. 



max 



log 



i P , 



+f 



log 



•log 



£2 



(15) 



wherein the first term represents the Max-Log approximation while the second term is a 
refinement. The refinement can be expressed as 



^x|)=log(l + e-W) 



(16) 



Both the Max-Log approximation and the refinement may be applied to the method of 
converting soft symbols to soft bits described herein. 

The invention provides several advantages. A key advantage is that a bit-wise or 

10 symbol-wise interleaver can be used in the system while nevertheless providing soft bit 
information to a soft input FEC decoder, e.g., soft decoder for turbo codes, convolutional 
codes, etc. Another advantage of the invention is that the conversion of soft symbols to soft 
bits is independent of the type of equalizer used in the receiver so long as soft symbol values 
are generated. Another benefit is that both the optimal and the approximate methods are 

1 5 computationally efficient in that a minimum number of arithmetic operations are required for 
their implementation. In addition, the method does not require any additional memory for 
storage of past or future data. 

GSM EDGE Embodiment 

A GSM EGPRS mobile station constructed to comprise means for performing the soft 
20 symbol to soft bit conversion method of the present invention is presented. A block diagram 
illustrating the functional processing blocks in a GSM EGPRS mobile radio station is shown 
in Figure 8. The radio station is designed to provide reliable data communications at rates of 
up to 384 kbit/s. The GSM EGPRS mobile station, generally referenced 140, comprises a 
transmitter and receiver divided into the following sections: signal processing circuitry 146, 
25 baseband codec 144 and RF circuitry section 142. 

In the transmit direction, the signal processing portion functions to protect the data so 
as to provide reliable communications from the transmitter to the base station 159 over the 
channel 158. Several processes performed by the channel coding block 150 are used to 
protect the user data 148 including cyclic redundancy code (CRC) check, convolutional 
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coding, interleaving and burst assembly. The resultant data is assembled into bursts whereby 
guard and trail symbols are added in addition to a training sequence midamble that is added to 
the middle of the burst. Note that both the user data and the signaling information go through 
similar processing. The assembled burst is then modulated by a modulator 152 which may be 
5 implemented as a 3tt/8 offset 8-PSK modulator. 

In the receive direction, the output of the baseband codec is demodulated using a 
complementary 8-PSK demodulator 164. Several processes performed by the channel 
decoding block 166 in the signal processing section are then applied to the demodulated 
output. The processes performed include burst disassembly, equalization, soft symbol 

10 generation, soft symbol to soft bit conversion in accordance with the present invention, de- 
interleaving, convolutional decoding and CRC check. 

The baseband codec converts the transmit and receive data into analog and digital 
signals, respectively, via D/A converter 154 and AID converter 162. The transmit D/A 
converter provides analog baseband I and Q signals to the transmitter 156 in the RF circuitry 

15 section. The I and Q signals are used to modulate the carrier for transmission over the 
channel. 

In the receive direction, the signal transmitted by the base station over the channel is 

received by the receiver circuitry 160. The analog signals I and Q output from the receiver 

are converted back into a digital data stream via AID converter 162. This I and Q digital data 
20 stream is filtered and demodulated by 8-PSK demodulator 164 before being input to the 

channel decoding block 166. Several processes performed by signal processing block 146 are 

then applied to the demodulated output. 

In addition, the mobile station performs other functions that may be considered higher 

level such as synchronization, frequency and time acquisition and tracking, monitoring, 
25 measurements of received signal strength and control of the radio. Other functions include 

handling the user interface, signaling between the mobile station and the network, the SIM 

interface, etc. 

Simulation Results 

To illustrate the benefits of the method of the present invention, a GSM Enhanced 
30 General Packet Radio System (EGPRS) was simulated and the results are presented herein. 
The simulation was performed assuming a GSM EGPRS transmitter and static channel with 
punctured rate 1/3 convolutional coding. 
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The EGPRS system is a Time Division Multiple Access (TDMA) system wherein 
eight users are able to share the same carrier frequency. In an EGPRS transmitter, the data 
bits are encoded with a rate 1/3 convolutional encoder, interleaved and mapped to 8-ary 
symbols. The resultant coded data symbols together with the training sequence are assembled 
5 into a burst of 142 symbols as shown in Figure 9. 

In GSM, the training sequence is sent in the middle of each burst. Each fixed length 
burst 180 consists of 142 symbols preceded by a 3 symbol tail 183 and followed by a 3 
symbol tail 187 and 8.25 symbol guard 188. The 142 symbols include a 58 symbol data 
portion 184, 26 symbol training sequence 185 and another 58 symbol data portion 186. Since 

10 the training sequence is sent in the middle of the burst, it is referred to as a midamble. It is 
inserted in the middle of the burst in order to minimize the maximum distance to a data bit 
thus minimizing the time varying effects at the ends of the burst. 

The burst is then modulated using 3rc/8-offset 8-PSK with Gaussian pulse shaping in 
accordance with the GSM standard. The modulated output is transmitted over a frequency 

15 selective static Gaussian channel utilizing punctured rate 1/3 convolutional coding. An 
equalizer operative to generate soft symbol values was used in the receiver. The receiver was 
adapted to convert the soft symbol information into soft bit information in accordance with 
the method of the present invention. A soft input Viterbi Algorithm based convolutional 
decoder was used as the outer decoder. The soft bit values output from the converter were 

20 used as input for the soft decoder. 

A graph illustrating BER at the output of the outer decoder versus SNR for a 
concatenated communications receiver constructed with and without the soft decision symbol 
to bit converter of the present invention is shown in Figure 10. The solid curve 190 
represents the BER at the output of the outer decoder when hard decisions only were used by 

25 the decoder. The solid curve 192 represents the BER versus SNR when soft bit decisions 
computed from the soft symbol decision information were used by the decoder. It can be seen 
that performance gains of over 2 dB can be achieved using the present invention when 
compared to hard decision decoding. For example, at a BER of 10" 3 , a performance gain of 
approximately 2.5 dB is achieved when using the soft decision information. 

3 0 Computer Embodiment 

In another embodiment, a computer is operative to execute software adapted to 
perform the soft symbol to soft bit conversion method of the present invention. A block 
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diagram illustrating an example computer processing system adapted to perform the soft 
decision symbol to bit conversion methods of the present invention is shown in Figure 11. 
The system may be incorporated within a communications device such as a receiver part of 
which is implemented in software. 
5 The computer system, generally referenced 200, comprises a processor or central 

processing unit (CPU) 202 such as a digital signal processor (DSP), static read only memory 
204 and dynamic main memory 206 all in communication with the processor which may 
comprise a microcontroller, microprocessor or microcomputer. The processor is also in 
communication, via a bus 226, with a number of peripheral devices that are also included in 

10 the computer system. An A/D converter 208 functions to sample the baseband signal output 
of the front end 224 coupled to the channel 222. Samples generated by the processor are 
input to the front end via D/A converter 207. 

One or more communication lines 218 are connected to the system via I/O interface 
210. A user interface 212 responds to user inputs and provides feedback and other status 

15 information. A host interface 214 connects a host device 216 to the system. The host is 
adapted to configure, control and maintain the operation of the system. The system also 
comprises magnetic storage device 220 for storing application programs and data. The 
system comprises computer readable storage medium which may include any suitable 
memory means including but not limited to magnetic storage, optical storage, semiconductor 

20 volatile or non-volatile memory, biological memory devices, or any other memory storage 
device. 

The soft symbol to soft bit conversion software is adapted to reside on a computer 
readable medium, such as a magnetic disk within a disk drive unit. Alternatively, the 
computer readable medium may comprise a floppy disk, Flash memory card, EEPROM based 
25 memory, bubble memory storage, ROM storage, etc. The software adapted to perform the 
soft symbol to soft bit conversion method of the present invention may also reside, in whole 
or in part, in the static or dynamic main memories or in firmware within the processor of the 
computer system (i.e. within microcontroller, microprocessor or microcomputer internal 
memory). 

30 In alternative embodiments, the method of the present invention may be applicable to 

implementations of the invention in integrated circuits, field programmable gate arrays 
(FPGAs), chip sets or application specific integrated circuits (ASICs), wireless 
implementations and other communication system products. 
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It is intended that the appended claims cover all such features and advantages of the 
invention that fall within the spirit and scope of the present invention. As numerous 
modifications and changes will readily occur to those skilled in the art, it is intended that the 
invention not be limited to the limited number of embodiments described herein. 
Accordingly, it will be appreciated that all suitable variations, modifications and equivalents 
may be resorted to, falling within the spirit and scope of the present invention. 
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